PERTURBING TRANSIENT RANDOM WALK IN A RANDOM 
ENVIRONMENT WITH COOKIES OF MAXIMAL STRENGTH 



ELISABETH BAUERNSCHUBERT 



Abstract. We consider a left-transient random walk in a random environment on 
Z that will be disturbed by cookies inducing a drift to the right of strength 1. The 
number of cookies per site is i.i.d. and independent of the environment. Criteria for 
£\J recurrence and transience of the random walk are obtained. For this purpose we 

use subcritical branching processes in random environments with immigration and 
formulate criteria for recurrence and transience for these processes. 

o 

1. Introduction 

We investigate random walks with random transition probabilities. Therefore, set Q := 
([0, 1] N ) Z with elements uj = ((co(x, i))i>i) x &- Suppose that elements from Q are chosen 

i i at random according to a probability measure P on fl with corresponding expectation 

operator E. For fixed environment u G Q and z6Z define a nearest-neighbour random 
walk (S n ) n >o on a suitable probability space Q' with probability measure P*, w , which 

\Q satisfies: 



O 



Pz,lu[So = z] = 1, 
Pz,ui[S n +l = S n + 1 1 (S m ) l< m <n\ = u(S n , #{?7l < 71 \ S m = S n }), 

Pz,oj[S n +i — S n — l|(5' m )i< m < ri ] = 1 — co(S n , j^{vn < n : S m = S n }). 



In this way u)(x, i) is the transition probability from x to x + 1 upon the i th visit at site 
.£h x. Furthermore let us denote the so-called annealed or averaged probability measure by 

P x [-) := E[P XjW [-]], with corresponding expectation operator E x . The process (S n ) n >o is 
called recurrent (transient) if S n = infinitely often (lim^oo S n G {±oo}) P -a..s. 

In the case where for P-a.e. u there exists a sequence (p 2 ) 2G z £ [0, l] z such that co(z, i) = 
p z for alH > 1, z G Z, and (p 2 ) ze z i-i-d.. under P, (S n ) n >o is called a one-dimensional 
random walk in a random environment (RWRE). In general, we refer the reader to [T5l 
[T7] for results and information about RWRE, but give here the recurrence/transience 
criteria for RWRE found in [151 Theorem (1.7)]. 
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Theorem RWRE (Solomon 1975). Consider an RWRE (S n ) n >o and assume that < 
p z < 1 for all z G Z or < p z < 1 for all z G Z. Lei Eflogpo] ^ e defined, where 
Po ■= (1 -PcOPo 1 - 

(%) 7/E[logpo] < 0, i/ien Hindoo 5* n = +oo P -a.s. 
(zi^ 7/E[logpo] > 0, i/ien lim^oo S n = — oo Po-a.s. 

(mj 7/E[logpo] = ; then — oo = liminf^oo < limsup^^ 5 n = oo Po-a.s. 

We can see that the RWRE is a special case of a multi-excited (cookie) random walk 
(ERW) with infinitely many cookies per site. In the ERW-model u(z, i) is not restricted 
to be constant in % for all z G Z P-a.s. Excited random walks go back to the work of 
Benjamini and Wilson in [6]. Further studies of these processes and an extension to 
multi-excited random walks have been made by Zerner in [HI [19], by Basdevant /Singh 
in [HE] and by Kosygina/Zerner in [10]. In [TBI Theorem 12] Zerner proves the following 
recurrence and transience criteria. 

Theorem ERW (Zerner 2005). Assume that to G ([1/2, 1] N ) Z P-a.s. and (co(x, -)) x > is 
stationary and ergodic under P. Then, (S n ) n > is recurrent if and only i/E[5^ i>:L (2a;(0, i) — 

1)]<1- ' 

In [10] Kosygina and Zerner discussed an ERW with a bounded number of cookies, 
i.e. u(z,i) = 1/2 for all % > K for all z P-a.s. for some constant K, and showed the 
following in [10, Theorem 1]. 

Theorem ERW (Kosygina, Zerner 2008). Let K G N and u(z,i) = 1/2 for all 
i > K for all z P-a.s. Assume that (uj(z, -)) z ez is i-i-d., EQT^Lj a>(0, n)\ > and 

E[lE=i(l-w(0,n))] > 0. If 6 := EE^i(2w(0,n)-l)] G [-1,1] then (S n ) n > is 
recurrent. If 5 > 1 (8 < —1 respectively) then (S n ) n >o is transient to the right (left 
respectively). 

The recurrence and transience criteria for the RWRE and for the ERW seem to be quite 
different. So the challenging question arises whether one can find a unifying criterion. 
In the present paper we begin with a small step in our undertaking and consider the 
following combination of these processes which we will call excited random walk in a 
random environment (ERWRE for short). For an illustration of the model discussed in 
this paper see Figure [TJ 

Consider an environment (p z )zez G (0, l) z and put M z cookies on every integer z G 
Z. Now a nearest neighbour random walk (5' n ) n >o is started at with the following 
transition probabilities. If the random walker comes to site z and if there is still at least 
one cookie on this site, he removes one cookie and jumps to z + 1. Otherwise he makes 
a step to the right with probability p z and to the left with probability q z := 1 — p z . 
The cookies in our model have maximal strength and induce a drift to the right. On 
the other hand, an environment {p z ) z ^z is assumed that makes an RWRE (i.e. without 
cookies) tend to — oo. So jump- and cookie-environment cause a drift in opposite 
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Figure 1 . Model of the random walk. 
If there are cookies at his current position z£Z, the random walker removes 

one and makes a step to z + 1. If there is no cookie he jumps to the right with 

probability p z and to the left with probability q z := 1 — p z . 

directions and the question naturally arises which drift is stronger in certain cases. We 
found criteria for transience and recurrence of the process. 

Let us define the number of cookies of strength 1 at site x G Z by 

M x := if {% > 1 : u(x,j) = 1 VI < j < i} = 0, 
M x := sup{i > 1 : u(x,j) = 1 VI < j < i} otherwise. 

For further discussions we postulate the following. 

Assumption A. A.l It holds P-a.s. that for all x G Z there exists p x G (0, 1) such 
that u(x, i) = p x for all i > M x . 
A. 2 (p z )zez is identically distributed and {p z ,M z ,z G Z} is independent under P. 
A. 3 E[| log(po)|] < oo and E[log(po)] > where p x := (1 — p x )p~ 1 for x E Z. 
A.4 F[M X = oo] = and F[M X = 0] > for all x G Z. 



Recall that A. 3 implies that an RWRE is left-transient, i.e. S n — > —oo a.s. The goal of 
this paper is to show the following recurrence and transience criteria. 

Theorem 1.1. Let Assumption^ hold and assume that (p z , M z ) zGli is i.i.d. andE,[pQ 1 



< 



oo. 



(i) 7/E[(logMo)+] < oo, then lim n ^oo S n = — oo Po-a.s. 

(ii) J/E[(log M )+] = oo and i/limsupt^^-Pflog M > t\) < E[logp ], then S n = 
infinitely often P -a.s. 

(Hi) 7/liminf j^oo (t • P[logM > £]) > Eflogpo]; then lim^oo S n = +oo Po-a.s. 

In [U El Uni UHl in] the random walker steps to the right or to the left with equal proba- 
bility at sites without cookies. Furthermore, the number of cookies per site is bounded 
in jH [TO] • In the case of ERWs in two and higher dimensions, Holmes investigates 
in [8] the velocity, allowing infinitely many cookies, and discusses a question of "which 
drift wins?" for a certain subclass of models, so-called "excited against the tide" walks. 
Schapira considers in his unpublished paper [13] a model similar to the one used in this 
paper, where the cookies induce a positive drift and the walker gets a negative drift on 
sites without cookies. But the number of cookies per site is still bounded. The novelty 
in our model is that the number of cookies per site is not necessarily bounded and that 
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we allow a random environment for the transition probabilities on sites without cookies. 
However, cookies of maximal strength are considered only. 



For the proof of Theorem 1.1 a well-known relationship between branching processes 
and random walks is used. This method also has been employed in [U El HO] • In our 
case we have to deal with a subcritical branching process in a random environment 
with immigration and we also intend to prove a recurrence/transience criterion for this 
process. As can be seen in our further discussion there is some similarity to random 
difference equations. 

Since the late 1960s several authors worked on branching processes in random environ- 
ments (BPRE for short), for example Athreya, Karlin, Smith and Wilkinson in [lj |2| [Li] . 
In [12] Pakes proved some recurrence/transience criteria for subcritical branching pro- 
cesses with immigration, but without a random environment. The results presented in 
our paper differ from the ones in [TJ], mainly because of the extension to a random 
environment, but also if we assumed fixed environments. 



Let us now give the structure of this paper in a few words. Section [2] is dedicated to 
subcritical branching processes in random environments with immigration. In Section 
[3] we consider the model with cookies on the positive integers only. The process with 
cookies on the negative integers only will be discussed in Section |4} Finally, Theorem 
1.1 is proven in Section [5] and examples are given for the different cases of this theorem. 



2. Transience and recurrence of subcritical branching processes in a 
random environment with immigration 

For information about branching processes in general we refer to [3]. In our paper we 
deal with the following Smith- Wilkinson model extended by immigration, see also [2] 
and |3l VI.5 and VI.7.1]: 

Definition 2.1. Let A denote the set of probability generating functions (p.g.f.) that 
is isomorphic to the set of probability distributions on No and let i? be a probability 
distribution on No- Let , M n , i,j, n G N} be a family of No- valued random variables 
on a suitable probability space with sample space A' equipped with a set of measures 
{Q v ,tp G A N } such that for every fixed environment tp = (y>j)jeN G A N the family 

{$\M n ,i,j,n G N} is independent, (Ci^ieN is identically distributed with p.g.f. (pj 
for j G N and (M n ) ng N is identically ^-distributed under Q v . We call (Z n )„> , defined 
by Z$ = 1 and 

a branching process with immigration. 

Let v denote a probability measure on A and <p be randomly chosen according to 
Q '■— <S>n v on vl N with corresponding expectation operator E. Now we define the 
annealed measure by Q[-} := by Eq its expectation operator and call (Z n ) n > 

a BPRE with immigration under Q. 
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In the above definition £ 4 - n ^ gives the number of progeny of the i th member of generation 
n — 1, and M n the number of immigrants in generation n. All members in a generation 
reproduce according to the same offspring distribution. Due to our further discussion, 
especially in Section |3j we use the same notation for immigrants as for cookies. Note 
that ((ipn, M n )) ng N is identically distributed and {ip n , M n , n e N} is independent under 
Q. Furthermore, we remark that (Z n ) n >o is a time-homogeneous Markov chain under 
Q. In order to speak about recurrence and transience of the process it is assumed that 
the BPRE with immigration is irreducible under Q. 

Let us set E 9 for the expectation operator corresponding to Q v and /J n (tp) : = E 9 [t^] 
for the expected number of offspring produced by a single member of generation n — 1. 
Analogously to the literature, we call (Z n ) n >o subcritical, critical or supercritical, if 
.Egflog/ii] < 0, = or > respectively. This is due to the fact that under the first 
two assumptions, a BPRE without immigration is mortal, whereas under the third 
assumption this process can explode, see [HJ Theorem 3.1] or [3, VI. 5.5]. Note the 
analogy to Theorem RWRE (i) — (in), see also [TUl Remark 2]. 

Let us now give criteria for recurrence and transience of a subcritical BPRE with 



immigration in Theorems 2.2 and 2.3 We remark that these criteria are similar to the 



ones for random difference equations found in [9J Theorem 3.1]. 



Theorem 2.2. Let (Z n ) n >o be a BPRE with immigration according to Definition 2.1 
Suppose that Eq[\ log(//i)|] < oo ; EgflogfjUi)] < ; Eq[[i{ 6 ] < oo for some 8 > and 

J/liminf t_j.no (t • Q [log Mi > £]) > E Q [log(/i 1 then (Z n ) n > is transient. 

Proof. The proof will be divided into two parts. First, we discuss a random difference 
equation X n for n G No, and show that Qtf~\ n> i{X n > n 2 }] > 0. The second part 
consists in coupling (X n )„> and the subcritical BPRE with immigration in order to 
show that [lim^oo Z n = oo] > for Q-a.e. ip. 

First, let us define some constants. We write 

x := £ Q [logOO] >0 
and choose c\ < oo, c 2 > 1 and c 3 > 1 such that 

liminf(t • Q [log Mi > t\) > c\ > logc 2 + c 3 x > 0. 

t— >oo 

Furthermore, let e G (0, C\ — (logc 2 + c 3 x)) and define 

7 : = \ > !• 

e + log c 2 + c 3 x 

We choose < / < 1 such that (1 — l)^ > I. 

In order to make use of a convergence property, set 

7 := ml {k G N : > k : - ^ log/i m > -c 3 x } . 
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Then, T < oo Q-a.s. by the law of large numbers. A result about large deviations under 
the assumption Eq[h^ 9 } < oo, see [7J p. 71], gives 



Q 

for some c > 0. This implies 

(!) e q \tt]=J2Q[t 



> nc^x 



m=l 



n\ ■ n 



n>l 



n>l 



n-1 



m=l 



n ; < oo. 



We begin now with a random difference equation defined by X := and 



X n+1 :— a n+ iX n + M n 



+1; 



with a n := /i n c 2 1 < /i„. Induction yields 



X„ = a n . . . a 2 Mi + a n . . . a 3 M 2 + . . . + a„M n _i + M n 



We follow j9] in setting 

W n := Mi + «iM 2 + aia 2 M 3 + . . . + e*i . . . a n _iM n 

for nGN. Since (ipi, Mi), . . . , ((/?„, M n ) are exchangeable, the law of X n and the law of 
W n are the same, in particular 



(2) 



Q[X n < n 2 } = Q[W n < n 2 } for all n E N. 



Our first goal is to show that 



(3) Q 



liminf{X n > n 2 } 



Therefore, let us start with a discussion of W n : 

Q[W n < n 2 ] = Q[W n <n 2 ,T> n l ) + Q[W n < n 2 , T < n l ) 
(4) <Q[T>n l ] + Q[W n <n 2 ,T<n l ], 
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and by definition of ctj and T: 



Q[W n <n 2 ,T <n l ] < Q 



p| {M l+1 <n 2 { ai ... a 

n l <i<n 



< Q 

< Q 



l },T<n l 
f| {M l+1 <n 2 (c 2 -e C: n i },T<r 



n l <i<r 



f| {M l+1 <n 2 (c 2 -e^Y} 

n l <i<n 

J] Q[M l <n 2 (c 2 -e c ^ x ) i ] 

n l <i<n 



exp 



E ^(i-Q 



2 /„ „cjni 



. n l <i<n 



(5) 



< exp ( - Q 

n l <i<n 



Mi > n 2 (c 2 e 



2 ^ ^aA* 



Mi > n 2 (c 2 e 



According to liminf^oo^ ■ Q [log Mi > t]) > ci, we get for n large enough 



E e 

n l <i<n 



Mi > rT (c 2 e 



2 („ a c 3 x\i 



> 



E 



Cl 



n l <i<n 

* E 

n l <i<n 



2logn + i (log c 2 + c 3 • x) 

Cl 

it + i (log c 2 + c 3 • x) 



(6) 



= E E 

l<j<n l<i<n ; 

> T (log(n)- (log (n')+l)) 



For the last inequality we used the convergence of (J^ILi - — l°g as n oo twice. 
Thus, combining ^ with ([6]) yields for n large enough 

Q[W n <n 2 ,T< n l ) < e^M™ 1 '') • e 7 < n^ 1 ^ ■ e 1 

And finally we get by ^ and (U 

5^ Q [X < n 2 ] < ^(Q[Ti > n) + Q[W n < n 2 , T < n 1 )) < oo 



n>l 



n>l 



since En>i™ ( ' _1) ' 7 < 00 and En>i^[ T ^ > "] < ^q[ t ^] < °°, see Q. 
Thus, by the Borel-Cantelli Lemma, we obtain (|3]) and one can check that 

(7) (J, f){X n >n 2 } 



n>l 



> for Q-a.e. ip. 
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Therefore, note that for Q-a.e. ip there exist Xq > Xq > n 2 , with 



{x no =x }n p| {X n > n 2 } 



> and Q H 



n>no+l 

Let us define recursively two processes 

y(*o) ._ n y(*o) , a# 



{x no = x } n f) {x, > j 2 } 

j= i 



> 0. 



r .— xo, 



n +n 



y(*o) ._ ~ 



Y?°> := « no+n • + M no+n for nGN. 
Since x > x we have that > Yn X °\ Thus, ^ follows by 



L n>l 

> o. 



no-l 



> n2 } > i x n = £o} n fl {x, > j 2 } n p|{^' o) > K + 



n) 



no— 1 



{x no = x } n f| {x, > j 2 } 

3=1 



3=1 



n>l 



f]{Y^>(n + n) 



n>l 



Our next objective is to couple (X„) n >o and BPRE with immigration. Therefore, recall 



Definition 2.1 for the branching process (Z n ) n > . If we couple these processes, the in- 



crements of the difference equation correspond to the immigrants in the BPRE and the 
multiplication with a n to the expected number of descents of one individual in genera- 
tion n — 1, multiplied by . Our goal is to show that Q v [f] n>1 {Z n > X n > n 2 }] > 
for Q-a.e. ip. 

We define for n EN n 



B n := f|{^ > x 3 } n P| {X k > k 2 }. 

3=1 



Then, we get for Q-a.e. (p, 

Qip [Z n < X n , -B„-i] = 



< 



E ^ 

fc>(n-l) 2 

E ^ 

k>(n-l) 2 



k>l 



I'r. 



Q v [Z n < X n , Z n -\ — k, B n -i] 

k>(n-l) 2 
k 



i=l 
k 



i=l 



Qi/j [-Zn_i — fc, S n _i] . 
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Now, Chebyshev inequality implies 



i=l 



< 



< 



Var^ ( £ e, 



(n) 



Thus, we have 

Qip [Z n < X n , B n _i] < 



Var, 



and therefore 



^2Q V [Z n < X n \B n _i\ < oo Q-a.s. 



Qif [Bn-l] 



net 



according to assumption i?g[Var ¥ ,(^| 1 ' ) ) • \i x 2 ] < oo and [ITJ Theorem 4.2.1.]. It is easy 
to see that for all n > 1 and Q-a.e. tp Q v [Z n < X n \B n _i] < 1. Now we conclude from 
Q and g that 



f){z n >x n } 



f|{^>^} 



[^n > ^n|5„_x] > . 



neN 



Combining this with (J7j) we can assert that for Q-a.e. 



lim Z„ = oo 



f|{^>^n} 



.n6N 



feeN 



•a 



Therefore, 



lim Z n = oo 



lim Z n = oo 



.fceN 



> 



> 0. 



which completes the proof. 



□ 



The following theorem gives a criterion for recurrence. 



Theorem 2.3. Let (Z n ) n >o be a BPRE with immigration according to Definition 2.1 
with Q[M n = 0] > and <£>i(0) > Q-a.s. Suppose that Eq[\ log^^f 1 )!] < oo and 

^[logOr 1 )] > o. 

I/limsup Woo (t ■ Q [log Mi > t]) < ^[log^ then (Z n ) n > is recurrent. 



Proof. We will show that ^2 n>0 Q[Z n = 0] = oo, which is equivalent to the recurrence 
of the process since (Z n ) ne ^ is a time-homogeneous Markov chain under Q. For the 
proof we use a second well-known definition for a BPRE with immigration, illustrated 
in Figure [2j and employ the exchangeability of ((<£>&, M k ))i< k < n under Q for n G N. 
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Equivalently to Definition 2.1 the BPRE with immigration can also be defined by 



3=0 

where for j G No, (Z n (j)) ne ^ is an ordinary BPRE characterized by offspring p.g.f. 
(<Pn+j)neN with Z o (0) = 1 and Z (j) = Mj for j > 1. Furthermore, the BPREs have to 
be independent under conditioning on ip, see [3] p. 250]. For an explanation see Figure 

El 



<P 4 





I 

• l M 3 =* 



M,=0 







1 



FIGURE 2. BPRE with immigration: 
Thefi gure shows a realization of the first generations of the BPREs (^nO'))isNo , 
j G {0, . . . , 3}. The p.g.f. </?i f° r reproduction is written on the left side. Sum- 
mation over the n th row gives Z n . 

For the moment let us fix n G N. We exchange (</?i,Mx) by (<p n ,M n ), (ip2,M 2 ) by 
{ip n -i, M n _i), . . . (</? n , M n ) by M,.) and define Z o (0) = 1 and 

rt 

Z'n = ^2 Z 'n-jti), 
3=0 

where Z' n _Jj) uses the exchanged random vectors ((<fi, Mj))i<j< n , i.e. the distribution 
of Z' n _Jj) is given by <^n-j(y?n-j-i(- • • fi( s ) ■ ■ .)) Mn ~ J+1 — whereas the distribution of 
Zn-j(j) is given by <p j+1 (<p j+2 (. . . ^(s) . . .)) M ^ — and Z (j) = M„_ i+1 . Exchangeability 
of ((^fcjMfe))!^^ thus implies 

Q[Z n = 0] = Q[Z; = 0] for all n G N. 



The task is now to show that 



J2Ql Z 'n = 0] = OO. 



n>0 



Therefore let us examine Q^\Z' n = 0]. The strategy is the following: 

In the first generations a high value of immigration is allowed — knowing that the 

size of the population becomes small, when the time passes by, since we consider a 
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subcritical branching process — whereas later, when we come closer to the generation 
to be examined, there are only few people permitted to immigrate. 

Choose c > such that limsup t _ 5 . OC) (t ■ Q[logMi > £]) < c < -E , <g[log(/i|f )]. Thus, we 
obtain for large t G M, 



(9) 



Q[M X >t}< 



logt 



< 1. 



We consider some 7 > 1 such that 7 • c < £ , g[log(/i 1 )] and define for k G N 

c k := e^ k > 1. 

Note that the lines of descent are independent under conditioning on (p and that 
Q v [Z' 3 {n - j) = 0, Z' Q (n - j) < cj > <Pj(<Pj-i{. . . y>i(0) . . .)p ■ [Z' (n - j) < 
for 1 < j < n. Hence, we get for every iigN, 



Q v K = 0]>Q, 



n-l 



j=0 



i=o 



n-l 



Q v [^(n) = 0]-l[Q v [Z' n _ 3 (j) = 0, ^(j) < c„_,] 



i=o 



n-l 



(10) 



> qim, = 0] n . . ^(0) . . .)) cj • n q t M i+i ^ c ^ 
j=i j=i 



Since a n > Q-a.s., we are able to consider for n > 2 

a r , 



«n-l 



— = • • ¥>i(0) . . .)) c " • Q v [M n < c-i] • 



In the case of subcritical BPREs, convexity implies, see e.g. |TJ p. 1853], 

<p n (<p n -i(. . . y?i(0))) > 1 - /ii • . . . • \i n . 

Choose e > such that 7 ■ c + .Eg [log fii] + e < and let 

T := inf{£; G N : Vn > : - V log/x m < £ Q [log//i] + e}. 



n 

l<m<n 

By the law of large numbers, T < 00 Q-a.s. For every iVGNwe obtain on {T < N} 
for n > N, 

<Pn(<Pr*-l{. ■ ■ <Pl{0) ■ ■ -)) Cn > (1 - /in • • • • • Vl)^ 

> (\ _ e ™(^Q[log«l]+e)^c n 

(12) > 1 — e "(')" c +- B <3[ lo g^i]+ e ). 



12 ELISABETH BAUERNSCHUBERT 

Applying ^ yields 

(13) Q[M n < Cn-i] > 1 7 r for n large enough. 

7(n-l) 



Thus, we get from (11), (12) and (13) > 1 ^-r for n large enough and finally, by 

a criterion of Raabe and ( |10p , 

^g„[Z; = 0] = oo on {T<iV} 

n>0 

for any iVeN and hence Q-a.s. Therefore, we can conclude 

Y,Q\Zn = 0] = J2^ Z 'n = °1 = E^t^^n = 0]] = OO. 



n>0 n>0 n>0 



□ 



3. Random walk in a random environment with cookies on the positive 

integers 

We now return to the random walk (S n ) n >Q. This section deals with the case where 
cookies are only allowed on the positive integers. For its discussion a well-known con- 
nection between branching processes with migration and excited random walks is used. 
This idea was also employed in jH \5[ [TD] for a simple symmetric random walk disturbed 
by cookies. For detailed explanations we refer to [10J. 

In our case, an analogous relation between a subcritical BPRE with immigration and 
the ERWRE is obtained. The purpose of this connection is to prove a recurrence and 
transience criterion for (S n ) n >Q. 

Proposition 3.1. Let Assumption \A\ hold. Assume f[M z = 0] = 1 for all z E —No, 
(p n ,M n ) neN i.i.d. andElpQ 1 ] < oo. 

(i) I/liminf^o^ • PflogMi > t\) > E[logp ], then Poflim^^ S n = +oo] > 0. 

(ii) Iflimswpt^it ■ PflogMi > t]) < E[logpo], then Poflim^oo S n = +oo] = 0. 

Let us first derive the connection to BPRE with immigration and state some useful 
results. We denote the hitting time of k e Z by 

T k := ini{n e N : S n = k}. 

Lemma 3.2. Let Assumption \A\ hold. Assume F[M Z = 0] = 1 for all z E —No and 
(p n ,M n ) neN i.i.d. Then P [limn->-oo S n G {±oo}] = 1. 

Proof. We first show that Po,w [— oo < limsup n _ >00 S n < +oo] = for P-a.e. u G ft by 
using the strong Markov property for the process H n := (S m )o< m < n and Borel-Cantelli. 
Assume that there exists z G Z with lim sup^^ S n = z. Then z is visited infinitely 
many times. But so is z + 1 since p z (u) > 0. This is a contradiction. 
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Similar considerations show that P 0tU] [—00 < lim inf S n < +00] = for P-a.e. u. If 
lim inf n^oo S n = z for some z G Z, then z will be visited infinitely many times. After 
the M z (uj) th visit, all cookies on z have been removed and from this moment on, S n 
will visit z — 1 infinitely many times as well, our next contradiction. 

Finally, we claim that P ,w [hminf^oo S n = — 00, limsup^^ S n = +00] = for 
P-a.e. oj. This holds since — under the assumptions of the lemma — the environments 
on sites z < satisfy case (ii) of Theorem RWRE. Hence, we have Pq )U ,[Ti = 00] > 0. □ 

A relation between an RWRE and a BPRE without immigration has already been 
remarked in JTOj Remark 2]. We show that our model of an ERWRE can be associated 
with a BPRE with immigration. Consider fceN. Then, it holds for P-a.e. u G ft that 
on the event {J 1 *; < T < 00} the random walk has to do steps from k to k + 1 after 
its first visit in k until all cookies are removed and until it gets a chance to return to 
k — 1. Further steps from k to k + 1 can be regarded as the number of successes in coin 
tossing prior to the first failure with an unfair coin of probability pk to succeed. 

Let X± , i G N, j G Z, be a family of independent ±l-valued random variables on ft', 
such that 

Pw[XP = 1] = cj(j, i) and P Z J[X® = -1] = 1 - co(j, i). 
Following [10], the ERWRE can be realized recursively by 

S n+1 = S n + X^ n:Sm=Sn} forn>0. 

We call the events {x\ j) = 1} a success and {A^ = — 1} a failure and define 

■= ^{successes in (X$ k) ). >M between the (j - l) th and the j th failure} , 
V :=l, 

V k :=t[ k) + ...+&l i+ M k . 



Then, if Assumption [A| and (p n , M n ) n ^ i.i.d. hold, we obtain by Definition 2.1 that 



(Vk) k >o is a BPRE with immigration under P\, with immigrants (Mk) k >i and progeny 
given by (Q )i,j£N; where has geometric distribution geo-^ (l — Pj), i.e. P\,u[£,i — 
n] = Pj(oj) n ■ (1 — Pj(co)) for P-a.e. u. 



For the formalization of the connection let us define analogously to [10J 

U := 1 and U k := #{n > : n < T , S n = k, S n+1 = k + 1}, 

where denotes the number of upcrossings from k to k + 1 before the return to for 
fceN. Analogously to pJJ eq. (14), (15)] the following connection between U k and Vk 
can be formulated and proven. 

Lemma 3.3. Let Assumption\A\ hold and assume (p n , M n ) n( z^ i.i.d. It holds a.s. under 
Pi: 

U k = V k ■ l{v 3 >ovo<i<fc} for allk>l on {T < 00}, 

Uk < Vk for all k > 1 on {T = 00}. 
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The indicator function ensures the equality after the first return to of the random 
walker or, equivalently, the first time the population became extinct. 

Let us use the same definition of recurrence from the right as in [10, p. 1962]. 

Definition 3.4. The ERWRE is called recurrent from the right, if the first excursion 
to the right of 0, if there is any, is P -a.s. finite, i.e. Pi[T < oo] = 1. 



Now the connection between ERWRE and BPRE with immigration can be formulated 
in the following way. 

Lemma 3.5. Let Assumption \A\ hold and assume (p„,M n )„ e N i.i.d. The ERWRE 

{S n )n>o is recurrent from the right if and only if (Vk)k>o is recurrent, i.e. Pi[3k G N : 
V k = 0] = l. 



Proof. The definition of U k , Lemma 3.2 and Lemma 3.3 yield 



(14) 



{T = oo} = {U k > VA; > 1} C {V k > VA; > 1}. 



Pi 



On the other hand we get by Lemma 3.3 and (14) that 

Pi[V k > Vk > 1, T < oo] = Pi[f4 > Vfc > 1, T < oo] = ( 

and hence 

{V k > VA; > 1} C {T = oo}. 
Now, the lemma follows since 

Px[T = oo] = Px\y k > Vfc > 1] = 1 - Px[3k G N : V k = 0]. 



□ 



Lemma 3.6. Let Assumption [^4] hold. Assume f[M z = 0] = 1 for all z G — N and 
(p n , M n ) ngN i.i.d. If (S n ) n > is recurrent from the right, then all excursions are P -a.s. 
finite and P -a.s. there are only finitely many. 



Proof. The first statement can be proven equivalently to the one in [TUl Lemma 8]. For 
the second statement assume that there exist infinitely many excursions to the right 
with positive probability. Then S n visits site 1 infinitely many times with positive 
probability. This is a contradiction to Lemma [3. 2| □ 

Lemma 3.7. Let Assumption \A\ hold. Assume f[M z = 0] = 1 for all z G —No and 
(p n , M n ) ng N i.i.d. If (S n ) n >o is recurrent from the right, then Pq [lim^oo S n = — oo] = 1. 
If (S n ) n >o is not recurrent from the right, then Pq [lim^oo S n = +oo] > 0. 



Proof. If the ERWRE is recurrent from the right, then according to Lemma [3^6] all excur 
sions are Pq-b-.s. finite and there are only finitely many. Therefore, we get Pq [lim 

P [lim^oo S n = -oo] = 1. 



a—. •■yo • t, u 



and, applying Lemma 3.2 
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If (S n ) n >o is not recurrent from the right, the corresponding BPRE with immigration 



is transient by Lemma 3.5, i.e. Pi[3k 6 N : 14 = 0] < 1, and hence 



< Pi [Vfc > VJfe > 1] = Pi [T = oo] < Pa 
The lemma follows. 



lim S n = +oo 



□ 



Lemmata 3.7 and 3.5 finally show 



Proposition 3.8. Let Assumption \A\ hold. Assume P[M 2 = 0] 
(p n , M n ) neN i.i.d. If (Vfc) fc > is recurrent, then P [lim^^ S n = 
transient, then P [lim^oo S n = +oo] > 0. 



1 for all z G —No and 
-oo] = 1. If{V k ) k >o is 



The above results enable us to prove Proposition |3.1 



Proof of Proposition 3. 1 , The BPRE with immigration (Vk)k>o that corresponds to 
(Sn) n >o is given by immigrants (M n ) n >i and offspring distribution geof$ (l ~Pj), j G N. 
Therefore, given an environment oo G i?, the expected number of offspring produced by 
a single particle in the (j — l) th generation is 



(15) 
and 
(16) 



fij(u) := P(U£i' 



Cj)i 



1 



Pj(0O) 



P7» 



Pj(0O) 



In order to apply Theorems |2.2| and 2J3 we first check if the particular assumptions are 
satisfied. We have Po = Q. Assumption |A| includes by (15) that Eq[\ log(//i)|] < oo, 
Pgtlog^x)] < 0, P [Mt = 0] > and PqA^ = 0] = 1 - Pi(w) > P -a.s. Since 
EfpQ 1 ] < oo we obtain that Eolp,^ 1 ] < E^p^ 1 ] < oo and Po[Var a; (^ 1 ' > ) • /^(u/ 1- - 
-^olpr 1 ] < 00 by (J16[ ) . Hence, the proof is completed by combining Theorems 
and Proposition |3.8| 



2.2 



2.3 



□ 



4. Random walk in a random environment with cookies on the negative 

integers 



In this section we put cookies of maximal strength on the negative integers only and 
prove the following proposition for the ERWRE. 

Proposition 4.1. Let Assumption \A\ hold and assume F[M n = 0] = 1 for all n E No 

and (p z , M z ) z& _ m i.i.d. 

(i) 7/E[(logM_i) + ] < oo ; then lim^oo S n = — oo P -a.s. 

(ii) If E[(logM_i) + ] = oo, then lim inf S n = — oo and lim sup^^ S n = +oo 
Po-a.s. 
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The process can be illustrated by running against a wall and being thrown back. The 
random walk starts in and, according to the environment, is pushed more or less to 
the left side, i.e. towards the negative integers, see Theorem RWRE (it). But on this 
side it encounters sites with cookies, that push it back to the right, like a wall that 
it can't pass. Every time it returns to this site — it will return, since a left-transient 
environment is considered — the wall becomes smaller until it is all gone and the process 
can jump further left. Naturally, the question arises how tall the walls have to be in 
order to make the random walker return to between spotting and destroying a wall 
and in which cases this happens infinitely many times. First, let us state that each 
negative integer, or each wall, will be reached by (S n ) n >Q. 

Lemma 4.2. Let Assumption [A] hold. Assume P[M n = 0] = 1 for all n G No and 

(jp z , M z ) ze _n i.i.d. Then T). < oo P -a.s. for all k G — N. 



Proof. If all cookies are removed we get a left-transient RWRE, i.e. an RWRE that 
tends to — oo Pq-&.s., by Theorem RWRE (it). Now the lemma is proven by induction. 
For k — — 1 the statement is the same as for a left-transient RWRE. Therefore, it is 
true. Let it hold for k G — N. Then, we get for P-a.e. u, 

PoA T k-i < oo] = P 0)W [T fe < oo, inf{n G N : S Tk+n = k - 1} < oo] = 1 

since (ST k + n )n>o acts like an RWRE on sites larger than k. Therefore, it returns to k 
at least Mfc(a;)-tirnes and reaches k — 1 afterwards as well. □ 



Let z G Z. We define for m G N with — m < z 

A m (z) := {after the first visit in — m (S n ) n >o reaches — m — 1 before z}. 

Note that there are a.s. no cookies on the positive integers and by the first visit in — m 
all cookies on sites larger than — m have been removed. Since Eflogpo] > and by 
Theorem RWRE (it), the random walker returns to — m from every excursion to the 
right after his first visit in — m Po^-a.s. for P-a.e. u. Therefore, 



(17) {S n = z infinitely often} c 3 {S n < z eventually} = (J f] A 

k>(0V~z) m>k 



where {-} c denotes the complement of set {■}. 

By the strong Markov property (A n (z)) n( z?q is independent under P 0>ul for P-a.e. 
and thus, by (17) and Borel-Cantelli, 



(18) Po,w[S n = z infinitely often] 



if En>(OV-*)^K(20]<00 

1 if E„> ( ov-*)^o, w K(*)]=°o 



To get some criteria for convergence or divergence of this sum, we first have a closer 
look at an ordinary RWRE. The next lemma can be deduced from \T7\ eq. (2.1.4)]. 
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Lemma 4.3. Let z G Z ; k G N with —k < z. The quenched probability for an RWRE 
with start in —k to hit —k — 1 before z is 



1 + E/=- z +i U j= i P-j 



This result will be employed to prove the following lemma. 

Lemma 4.4. Let Assumption [A] hold. Assume P[M n = 0] = 1 for all n G No and 

(p z , M 2 ) zg _ N i.i.d. For z G Z and for F-a.e. oo G the following holds: 

fi) J /En>(0V- Z ) P 0,a;[^n(^)] = °°> i/ien EneN ^-t^EEnI = °°' 

(H) IfEnen M -n(u)e- Cn = oo for someC > E[logp ] > 0, thenJ2 n>{ov _ z) PoA A n^)} 
oo. 



Proof. Let zGZ. Lemma 4.3 implies for n > (0 V —z) 

M- 

(19) P ^[A»(«)]= f 1 " - , ^ n _! 1 



i + Er=- 2+ i I\TJ p-i ) V 1 + EL- 2+ i UU p-j t 



According to the law of large numbers, we can state for some e > and P-a.e. oo that 
for n large enough 

(20) =— ^ = e(~ E "=-+i log ^') < e - e(n+2) 

Hi=-*+i/>-i 

and consequently 



(2D £ 



xov-z) ni=-z+i p-j 



< oo. 



Let us fix such an environment w G i? and let no(uo) G N with Uq(oo) > —z such that 



(20) holds for all n > n (oo). Then, we have for n > n (oo) by (19) that 



U^-z+iP-jJ \ lli=-*+iP-i. 



u%- z+ ip-j) \ n™=-,+iP-j 
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E P »,"KM] s E f 1 - f 1 - 

n>n (uj) n>n (uj) \ \ \.lj=—z+\ 



1 



< 



n (u) 

E i—- — + 

n>n-o (u>) 

E Ifr^ + 



M_ 



rij=-z+i 



i 



nj=_*+i p-j 
i 



n; 



M_ 



n T~f n — 1 

P-i lli=-*fiP-i, 



Hence, the first statement of the lemma follows by (21). 



For the second part let C > E[logp ] > 0. Due to (19), we get for n G N, n > —z 

PaAMz)} < I 1 ^4=1 1 : 

\ p z ■ . . . ■ p_ n+ i • 2^ j= -z Pz • ■■■■ P- 3i 



By (21) and by applying the law of large numbers, there are P-a.s. constants c, c > 



such that for large n, 



< (l_ c . e -C(n+z))^- 



< e 



(1 - c ■ e~ z ■ e~ Cn ) 

-cM_„e" c " 



Cn\ M- n e 



The second assertion of the lemma is obtained by the equivalence of 



Y[ a n >0 & 



5^(1 - o n ) < oo, 

neN 



if < a n < 1 for all n > 1. 



□ 



In order to prove Proposition |4.1[ we have to deal with random power series. An 
application of [Til Theorem 5.4.1] yields for our case the following result. 

Lemma 4.5. 7/E[(logM_ 1 ) + ] = oo ; then J2 n >i M- n x n = oo P-a.s. for every x > 0. 
J/E[(log M_i)+] < oo ; then ^ n>1 M_ n x n < oo~P-a.s. for < x < 1. 



Gathering the results above we get Proposition 4.1 



Proof of Proposition J^_A_, Let E[(logM_i)+] < oo. Lemma 4.5 and (20) yield 

M_, 



E 



neN -I J-j 



■r-rn— 1 
IL=1 P-3 



< oo P-a.s. 
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Lemma 4.4 (z) implies ^ n> ( 0V -z) -^o^t^nl- 2 )] < 00 an d therefore, by (17) and (18) 
Po[S n < z eventually] = 1 for all z 6 Z. Hence, lim^oo 5* n = —00 Po-a.s. 



Let C > E[logp ]. If E[(logM_ 1 )+] = 00, then £„ ePi 
to Lemma 4.5 Therefore, S n >(ov-«) -^[^(z)] = 
by Lemma 4.4 (ii). Hence, (S n ) n >o hits each z G 



M_ 



-Cn 



(18), and the proposition follows. 



00 P-a.s. according 
00 is obtained P-a.s. for all z € Z 
Z infinitely many times Po-a.s., see 

□ 



5. Excited random walk in random environment 



Let us now prove our main Theorem |1.1| about recurrence and transience of a random 
walk in a left-transient random environment with cookies of strength 1. 

Proof. The results from Sections [3] and [4] are employed even though the environments u 
are not exactly the same. If we consider excursions to the right of 0, we apply Section 
[3j as long as cookies on negative integers have no influence on the behaviour of the 
random walker. In the case where the behaviour of the walker on the negative integers 
is studied we use Section [4] since the cookies on the right side of can be neglected in 
that case. 



Let E[(logMo)+] < 00. Proposition 4T] (i) gives us the following for P-a.e. u. If we 
remove all cookies on the positive integers then lim n _>.oo S n = —00 Po iU -a.s. On the 
other hand, E[(logM )+] < 00 implies limsup t ^ 00 (t • P[logM > t]) = since 



E[(logM ) 



> 



POO 

/ F[\og M >t]dt 
Jo 



gM >t, 



> 



9 E tn ' 



logM >t n ] 



neN 



i-n-1 



> 



for every sequence (t n )n>i with t n 
right is Po )U) -a.s. finite for P-a.e. u by Proposition 3.1 



It 

2 n 



> 0. Hence, every excursion to the 



Lemma 3.7 and Lemma 



3.6 Therefore, all cookies on positive sites that are visited by the random walker are 
removed. Consequently, the ERWRE tends to —00 Po, w -a.s. for P-a.e. uj. 

We turn to the second case. Excursions to the left of depend only on the environment 
left of 0, i.e. on ((u(x,i))i e ^) xe -^. Since E[(logM )+] = 00, every excursion to the 
left is Po-a.s. finite and the ERWRE returns to by Proposition 4.1 (ii). On the 



other hand, excursions to the right only depend on the environment right of 0. Since 
limsup t ^ 00 (t • P[log Mq > t]) < E[log(p )], every excursion to the right is Po-a.s. finite 

Hence, the process returns to 



by Proposition 3.1 



Lemma 3.7 and Lemma 3.6 



infinitely many times Po-a.s. 

In the last case, we have E[(logM )+] = 00. Since cookies only enforce the drift to the 
right E[(logM ) + ] = 00 implies that Poflimsup^^ S n = +00] = 1 by Proposition 4.1 
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(ii). By the assumption liminf t ^ 00 (t • P[logM > t\) > E[log(p )] and by Proposition 



3.1 (i), we obtain Po[S n — > +00] > 0. Furthermore, we also have Po[S n — > +00, B\ > 0, 
where B := {S n > So Wn > 1}. 

Applying Levy's 0-1 law, we get with the canonical filtration (J-"„)„>o of (S n ) n >o for 
P-a.e. u 

(22) Po,c[S n -> 00 1 7 Tr \ n ^ l{s„->oo} Po,<j-a.s. 
Furthermore, we see that for all n G N 

(23) P Q J[S n -» oo|^ Tn ] > PoASn -)• 00, > n \/k e N^] = P„, w [5 n -> 00, B]. 
The environment (u)(z, *))«6Z is i-i-d. under P. Thus, the ergodic theorem yields 

(24) _^^^[,S n ^+oo, J B] r ^> E[Po,c.[^^+oo, J B]]>0 P-a.s. 

n=0 

As a consequence, we get for P-a.e. uj that P nu \S n — > +00, S] > e for infinitely many 
n and for some e > 0. Finally, (22), (23) and (24) yield that l{5 n ^ 00 } = 1 P 0ul -a..s. for 
P-a.e. w and therefore, Pq[S u — > +00] = 1. □ 

Remark 5.1. Theorem |1.1| is still correct if P[M = 00] > and P[M = 0] > instead 



of Assumption A. 4 



In conclusion, we give some examples for the three cases of Theorem They have 
been motivated by and adapted from [TO], Theorem 1]. 

Example 5.2. Let the assumptions of Theorem 1.1| be satisfied and require A,/3 > 0. 
We set 

nM >k] := {1 + p logk)X for.>2,^N, 
P[M = 1] := 0, 
P[M = 0] := 1 ' 



(l + /31og2) A ' 
Now the following cases can be derived. 

(i) If A > 1, then Poflinv^ S n = -00] = 1. 

(ii) If A < 1, then P [h m n-s-oo S n — +00] = 1. 

(iii) If A = 1 and ■ Eflogpo] < 1, then P [h m n-5-oo S n = +00] = 1. If A = 1 and 
■ E[logp ] > 1, then P [S n = infinitely often] = 1. 

Proof. These results are due to Theorem 1 1 . 1 1 and due to the following calculations. 
In the first case we have E[(logM ) + ] < ^ fcgNo P[log M > k] < 00 since A > 1. 
To prove the second case, note that P[logM > t] > (1 + /3 log(e* + 1)) _A for t > and 
therefore liminL_ s . 00 1 P[logM > t) — 00 if A < 1. 

Finally, if A = 1 we obtain that E[(logM„) + ] > E fe eN P [ lo g M o > k] = 00 and 
lim^oot P[logM > t] — i. According to the value of (5 the ERWRE tends to +00 or 
is recurrent Po-a.s. □ 
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